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^ (54) Title: IMAGE SEGMENTATION 
fO 

£^ (57) Abstract: In a method of segmenting an image a first, seed pixel unit is selected from a first group of pixel units in which the 
pixel units all have substantially the same grey-level intensity. The grey-level intensity of said first pixel unit is compared with the 
grey-level intensity of each of selected adjacent pixel units of said image and those pixel units with grey levels within a selected 

^* range are assigned as a pixel unit of the same region as said first pixel unit. This comparison process is repeated for each of the pixel 
units in the image, those already having been assigned being ignored. A further seed pixel unit is selected from a further group of 
pixel units in which the pixel units all have substantially the same grey-level intensity and the comparison process repeated for all of 

£^ the unassigned pixel units. Further seed pixel units are selected and the comparison process repeated until all the pixel units of the 
image have been assigned. A watershed transform is then applied to provide the segmented image. 



WO 03/003303 



PCT/GB02/02945 



Image Segmentation 

The present invention relates to a process for segmenting images. 

There are many fields in which images such as digital images need to be processed in order to 
enhance the image for viewing and/or further processing. One such field is in medical imaging 
5 where, in X-ray Computed Tomo graphy (CT) for example, the images viewed by the medical 
specialist need to be sufficiently clear for aproper diagnosis to be made and treatment to be given. 

hi Computed Tomography a computer stores alarge amount of data from a selected region of the 
scanned object, for example, ahumanbodymaldngitpossibleto determine the spatial relationship 
of radiation-absorbing structures within the scanning x-ray beam. Once an image has been 
1 0 acquiredby scaiioingit is then subjected to segmentation which is atechnique for delmeatingthe 
various organs within the scanned area. 

Segmentation can be defined as the process which partitions an input image into its relevant 
constituent parts or objects, using image attributes such as pixel intensity, spectral values and 
textural properties. The output of this process is an image represented in terms of edges, regions 
1 5 and their inteixelationships. S egmentation is a key step in image processing and analysis, but it is 
one of the most difficult and intricate tasks. Many methods have been proposed to overcome 
image segmentation problems, but all of them are application dependent and problem specific. 

The general objective of segmentation of medical images is to findregions whichrepresent single 
anatomical structures. Thismalces feasibletasks such as interactive visualisation and automatic 
20 measurement of clinicalparameters. Medical segmentation is becoming anincreasingly hnportant 
step for a number of clinical investigations, these include: 

a) Identifying anatomical areas of interest for diagnosis treatment or surgery planning, 
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b) Pre-processing for multi-modal image registration and improved correlation of 
* anatomical areas of interest 

c) Tumour measurement for diagnosis and therapy. 

Over the last decade there have been anumber of advances inRadiotherapy Treatment Planning 
5 (RTP) and treatment delivery. These have resulted in the need for systems that can generate 
complex treatmentplans that are sensitive to the patients' anatomy, (the geometrical shape and the 
location ofthe organs) forplacement oftheradiationbeams. In such systems the complete and 
precise segmentation or contouring of therapy relevant structures (namely the gross tumour volume 
(GT V) 5 clinical target volume (CT V) and adj acent non-target normal tissues, to gether termed the 
1 0 Planning Target Volume (PTV) 5 is a crucial step and one major bottleneck in the whole treatment 
planningprocess. Itis estimated that 66% of all tumour patients are referred to radiation therapy. 
About 40% of these canbe treated effectively with ccuxent methods. Another 40% are not suitable 
fortreatmentbecausethe diseasehas spread too far. The remaining 20% could be treated if the 
planning methods were generally available, 

15 It is only by displaying the relevant structures that the clinical oncologist can devise an optimal plan 
that will treat the PTV to a givenprescribed radiation dose while minimising radiation of non-target 
tissues therebymaximisiiagthe therapeutic gain of treatment. Ihcommonpractice, the segmentation 
process is usually done manually slice by slice, and for a typical set of 40 slices, it canbe a time 
consuming and tedious process, 

20 The present invention seeks to provide an improved method of segmentation of an image. 

Accordingly, the present invention provides a method of segmenting an image comprising: 

selecting apixel unit from afirst group ofpixel units inwMchtlaepixelunits all have substantially the 
same grey-level intensity; 
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comp aring the grey-level intensity of said first pixel unit with the grey-level intensity of each of a 
plurality of selected pixel units of said image; 

assigning each said selected pixel unit as a pixel unit of the same region as said first pixel unit in 
response to the grey-level intensity of said adjacentpixelunitfallingwifiiinapreselected grey-level 
intensity range; 

selecting a further pixel unit from a further group of pixel units in which the pixel units have 
substantially the same grey-level intensity; 

comparing the grey-level intensity of said further pixel unit with the grey-level intensity of each of 
a plurality of selected pixel units of saidimage, wherein each selected adjacentpixelunitwhichis 
already assigned as a pixel unit of a region is ignored; 

assigning each unassigned said selected pixel unit as apixel unit of the same region as said further 
pixel unit in response to the grey-level intensity of said selected adj acent pixel unit falling within a 
preselected further grey-level intensity range; 

andrepeatingthe above steps until all ofthe pixel units in the image have been assigned to a region. 
The present invention also provides a method of segmenting an image comprising the steps of: 

(a) . selecting afirstpixel unit from afirst group ofpixel units in which the pixel units allhave 

substantially the same grey-level intensity; 

(b) selecting a first grey-level intensity range relative to the grey-level intensity of said first pixel 
unit; 



(c) comparing the grey-level intensity of said first pixel unit with the grey-level intensity of each 
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of selected adjacent pixel units of said image; 

(d) assigning each said selected adjacent pixel unit as apixel unit of the same region as said fiist 
pixel unit in response to the grey-level intensity of said adj acent pixel unit falling within said 
first grey-level intensity range; 

5 (e) comparingthe grey-level intensity of said fkstpixelunitwiththe grey-level intensity of each 
of selected next adjacent pixel units of said image; 

(f) assigning each s aid selected next adj acent pixel unit as a pixel unit of the same region as 
said first pixel unit in response to the grey-level intensity of s aid next adj acent pixel unit 
falling within said first grey-level intensity range; 

1 0 (g) repeating steps (e) and (f) for each of the pixel units in the image; 

(h) selecting a further pixel unit from a further group ofpixel units in which thepixel units have 
substantially the same grey-level intensity; 

(i) selecting a further grey-level intensityrange relative to the grey-level intensity of said further 
pixel unit; 

15 (j) comparing the grey-level intensity of said further pixel unit with the grey-level intensity of 
each o f selected adj acent pixel units of said image, wherein each selected adj acent pixel 
unit which is already assigned as a pixel unit of a region is ignored; 

(k) assigning each unassigned said selected adjacent pixel unit as apixel unit of the same region 
as said further pixel unit in response to the grey-level intensity of said selected adjacent 
20 pixel unit falling within said fiirther grey-level intensity range; 
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(1) comparing the grey-level intensity of sddftoherpixelrniitwitiitiie grey-level intensity of 
each of selected next adjacent pixel units of said image; 

(m) assigning each said unassigned selected next adjacent pixel unit as a pixel unit of the same 
region as said further pixel unit in response to the grey-level intensity of said selectednext 
5 adjacent pixel unit falling within said further grey-level intensity range; 

(n) repeating steps (1) and (m) for each of the pixel units in the image; 

(o) and r epeathig steps (h) to (n) until all of the pixel units in the image have b een assigned to 
a region. 

Preferably, said first group of pixel units is the largest group of pixel units in the image and said 
10 further group of pixel units is the next largest group of pixel units. 

The term "pixel unit" is used herein to refer to a single pixel or agroup of adjacentpixels which are 
treated as a single pixel. 

hi a preferred form of the invention the method further comprises the steps of building a mosaic 
image, deriving the gradient of the mosaic image and applying a watershed transform to said 
15 gradient to provide said segmented image. 

Advantageously, the method further comprises the step of applying a merging operation to said 
segmented image to reduce segmentation of the image. 

Preferably, each said pixel unit is a single pixel. 



The present invention is fiirther described herein after, by way of example, with reference to the 
20 accompanying drawings, in which: 

5 
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Figure 1 is a view of an image produced by a CT scan; 

Figure lais a flow chart of animageprocessuigtechmqiiea 
can be applied to the image of Figure 1; 

Figure 2 is an image produced from the image of Figure 1 by application of a Watershed transform; 

Figure 3 is a mosaic image generated from the image of Figure 1; 

Figure 4 is an image produced by a Watershed transfonnation of the image of Figure 3; 

Figures 5 A and 5B are frequency histograms of two of a set of image "slices" similar to that of 
Figure 1; 

Figure 6 is a frequency histogram showing a Gaussian distribution curve and anon Gaussian 
distribution curve superimposed on one another; 

Figure 7 is a simplified flowchart showing the process of op eration of apreferced method according 
to the present invention; 

Figure 8 is a detailed flowchart of part A of the process of Figure 7; 

Figure 9 is a detailed flowchart of part B of the process of Figure 6; and 

Figure 10 is a chart ofhistograms illustrating the effect of a couch andbackground on the histogram 
of Figure 9, 

Refeiringto tire drawings, Figure 1 shows an original grey scaleimagewhichisproducedbyaCT 
scan. Figure lais aflowchartof anhnageprocessmg technique accordingtothepresentinvention 
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which, canbe applied to the image of Figure 1 . lathe process, the image is transformed into a 
mosaic image and the gradient image obtained. It is the magnitude of the gradient which is used in 
order to avoid negativepealcs. A morphological gradient operator would avoid the production of 
negative values and produces animage which canbe used directlyby a Watershed transform. The 
5 Watershed transform, followedby a merging process is then applied to provide the final image of 
Figure 2. As canbe seen, the number of discrete regions in the image of Figure 2 is considerable 
and would normally be of the order of several thousands. In Hits particular example the number of 
regions is seven thousand nine hundred and sixty-eight. This image would then need to be 
processed manually by a skilled op erator in order to produce areasonable image for viewing by 
1 0 the medical practitioner (given the large number of regions this may become prohibitive in terms of 
time). 

In order to reduce the number of regions produced by the Watershed transformation, in the 
preferred form of Hie process the original image is digitally coded and stored with each unit (byte) 
of the digitally stored image representing the grey scale level of a pixel of the original image. 

15 As can be seen from Figure 2, when attempting to segment the image of Figure 1 the initial 
Watershed transform of the gradient image provides very unsatisfactory results since many 
apparently homogeneous regions are fragmented hi small pieces, hi the preferred process 
according to the present invention the Watershed transformationis applied to asimphfiedimage. 
In the simplified image the homogeneous regions of the original image are merged;, the simplified 

20 image of Figure 3 being made of a patchwork of pieces of uniform grey-level and is referred to as 
a partition or mosaic image. 

Although the loss of information, which occurs when the original image of Figure 1 is transformed 
into the mosaic image of Figure 3 3 is important, the main contours of the initial image of Figure 1 
are preserved. In such a simplified image, regions with identical grey levels may include actually 
25 different structures due to overgrowing. To solve this problem the simplified image is further 
transformed. 
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To begin the process, the pixels of the image are stored in a temporary list (theboundarylist) of 
pixels which are to be analysed. This list contains spatial information (x and y co-ordinates) and 
the intensity value of the pixels (grey-level). 

ha order to calculate the mosaic image of Figure 3 a multi-region growing algorithm is used. This 
5 starts withaseed pixel which eanbeprovidedbytheuserwho selects aseedpoint in the original 
image of Figure 1. This has previouslybeen effected manually, for example byusingapointing 
device such as amouse. The seedpoint chosen would normally be inside aregion of interest in the 
image. 

hi order to carry out this process automatically, a frequency histogram of the grey-levels of the 
1 0 original image is first of all determined, hi this way, each grey-level is referenced to each pixel 
within the original image which belongs to that particular level. Figures 5 A and 5B show a 
histograms of two image slices similar to that of Figure 1 inwliichit canbe seen that variousparts 
of the body such as muscles, organs and bone structures are characterised by or exhibit different 
grey-levels and therefore different distributions in the histogram. 

15 A predetermined grey-level in each distribution is taken as corresponding to the intensity value of 
a representative pixel of the region which is represented by that distribution. The pixels of each 
distribution which form the representative pixels are selected as the seed pixels for each growing 
operation. By automatically selecting these seed pixels from the histogram a step of manually 
pointing at the image to specify the location of the seed pixels is avoided. 

20 Each distribution of the histogram may be a Gaussian or non Gaussian distribution and Figure 6 
shows a diagrammatic representation of two distribution curves 1 0 5 1 2 of a frequency histogram. 
The curves represent two different regions of the histogram but are superimposed on one another 
to illustrate the differences between a Gaussian and anon Gaussian distribution. Curve 1 0 shows 
a Gaussian distribution with the threshold minimum and maximum grey levels for the region 

25 represented by the curve 10 being chosen atZ^andi,,,^ (points 14andl6onthecurves). Curve 
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12 shows anon Gaussian distribution superimposed on curve 1 0 with the minimum and maximum 
grey levels for the region represented by the curve also being chosen atL min zndL m(lx . In practice, 
because the our ve 1 2 would be in a different p art of the histogram the threshold grey levels would 
be different values, but they are shown here having the same values for ease of explanation. 

5 Intheprefeixedmethod, the predetermined grey level used to define therepresentativepixel (seed 
pixel) for each region is the average grey level in each distribution. 

Where a Gaussian distribution of the grey levels in a region occurs or is assumed (curve 1 0), since 
tire threshold grey levels for the region are equidistant from the distribution peak, the average grey 
level in the distribution is equal to the grey level corresponding to the peak of the distribution and 
10 is L ave = (L mi „ + L max )/2. 

Where, however, a non-Gaussian distribution of Hie grey levels in a region occurs, the average grey 
level in the distribution will not be equal to the peak of the distribution (curve 12). 

It will b e appreciated that in suchnon-Gaussian distribution the predetermined grey level used to 
define the representative pixel (seedpixel) for each region could be the average grey level, the grey 
1 5 level corresponding to the peak of the distribution or the grey level corresponding to the central 
position between the thresholds L min and L maxr 

Once the histogram has been created the grey level values of the pixels are sorted according to 
frequency in descending order, ie the pixels having an intensity value which occurs most frequently 
are placed first in the sorting order. The effect of this is that the representative pixels will occur at 
20 the beginning of the ordered-boundary list. It will be appreciated, therefore, that the region that 
occupies the largestportion of the image is grown first, the region occupying the second largest 
portion is grown second and so on. 



The growing process for the first region begins with the first pixel at the head of the ordered 
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boundary list. 

The first pixel in the list is scanned in order to determine whether ornotthe grey-level ofthe pixel 
lies within a certain intensity range . If the scanned pixel meets tire requirement it is transferred to 
a further store in a new list (the region list) . If the pixel do es not meet the requirement then it is 
5 ignored. 

If the scanned pixel meets the requirement then the eight immediately adj acent, surroundingpixels 
(which may or may not belong to distributions other than the one currently being created) ofthe 
image are tested to determine if they also meet the requirement and can therefore be included in the 
regionbeing grown. If aneighbourpixelbeing tested has alreadybeen assigned to aregionthen 

10 itisignored. Iftheneighbourpixelhasnotah*eadybeenassignedto aregionandpassesastatistical 
test for homogeneity criteria (ie if the pixel grey-level lies within a certain intensityrange) it is 
inserted in the region list and its identifier value in the original image is changed to the region value. 
This procedure is repeated until all the pixels in the image belong to one ofthe regions. It will be ■ 
appreciated that whilst the scanning refers to eight adj acent pixels, the scan maybe effected using 

15 other connectivities e.g. four or six. 

The following test is used as a basis for including a pixel in a region and applies for Gaussian 
distributions. It also applies for non Gaussian distributions where the average grey level intensity 
L aVB is used to determine the seed pixel. 

Here a pixel p x>y of intensity L (xy) is included in the region list if it passes the similarity criteria, i.e., 
20 if the following condition is satisfied: 

where L ave is the average grey intensity level and T w is a threshold ' Vindow" control parameter. 
In the case of curve 1 0 (Gaussian) of Figure 6, L ave is equal to the peak value grey level and is 
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midway b etween L max and L mhv Thus T w is equal to ( L max - L min )/2, The parameter L M acts as 
a central value for growing the region, andtheparameter T w acts as athresholding distance in pixel 
intensity units from the central value. 

ha anon Gaussian distribution where the average grey level intensity L ave is not equal to thepealc 
value grey level and therefore is not midway between!^. andZ w ,„, two thresholds T w] and T w2 
are needed, where: 

%*wJ ^w2 "~ L max " ^min 

Thus: 

L( X y>) ~ L ave ^ T wl f OT L (xy ) > L ave 

L ave " L^j < T w2 for L( xy j < L ave 

Before region growing is started, the values of the level parameter L ave and window control 
parameter r M ,must be set appropriately. The value of L ave may be set to the intensity value of the 
seed pixel, which in turn represents the central value of the region to be grown. Alternatively, it 
maybe obtained from aprevious processing step, which includes a statistical analysis of pixels 
around the region of interest. In this oasei flWf can be set equal to the mean of the sample region. 
Usually, a 20 x 20 pixel matrix is taken for the sample, but larger samples introduce a degree of 
data smoothing and may give more accurate calculation of the region statistics. However, if the 
sample area is too large then the computational time can become too long. 

The values of the parameter T w can be set interactively or automatically. 

To set the value of ^interactively the user can specify the value in a window which forms part of 
the GUI (graphical user interface) control panel for the algorithm. 
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A range of results canbe quickly observed simply by setting the threshold value T w at different 
levels in order to extract different regions from the original image. As will be appreciated, if the 
seed pixelremams the same, aMgher value f^^ 

being grown. Changing Hie seed pixel for the same threshold value r w will also produce a different 
grown region pattern. 

If the same value is used for the threshold value parameter T w then the process produces good 
results with high contrasting objects within the image, such as pelvic bones atidbody contour. 
However, this is not the case when segmenting soft tissues such as the bladder and seminal vesicles 
where the contrasts are relatively low between objects. Using a high threshold value T w results in 
a relatively small number of regions being produced (typically several hundred) which results in a 
loss of structures. With ahigh value of it is possible to obtain segmentation of just the bones and 
the body contour. 

If a low threshold value T w is used this results hi over segmentation with arelatively large number 
of regions (typically several thousand) being produced. 

The results are therefore dependent on the threshold value T„ and therefore in Hie growingprocess 
an adaptive threshold value T w is applied to each region instead of a single threshold value T w for 
the whole image. 

To set the threshold value T w automatically, it can be computed by the region growing algorithm 
which examines the statistics of the pixels within a sample regioni? of about 20 pixels in size (the 
figure of 20 may, of course, be varied as required). This sample region^ is located centrally over 
the seed p oint of the region. The window thresholdp arameter T w is coinputedby multiplying the 
standard deviation of the sample region with a scaling factor i^whichis dependent on the signal to 
noise ratio hi the image. A scaling factor K of value of 2.0 has been found to give reasonable 
results for CT and Magnetic Resonance (MR) images. 
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The threshold value T w for each region is calculated automatically by taking into account the 
histogram information. The threshold value T w for each region is calculated prior to and 
independently of the growing process and is effected firstly by looking for sequences of pixels in 
the histogram that follow a 6 c peak like 5 'pattern. To avoid identifying false peaks because of noise, 
5 the process ignores peaks which have apixel width less than apreselected number, typically seven 
pixels. If the grey-level spacingbetween adj acent p eaks is relatively large then the threshold value 
T w for the region being grown can also be large. Where the adj acent peaks are close together on 
the grey-level scale then the threshold value T w will need to be relatively small. 

The segmented image may still contain some false regions that are produced as a result of CT 
10 artifacts. These are undesired regions which are not wanted by the clinicians and are removed 
throiigh a merging process. 

Themergingprocess looks at adjacent regions and will merge a fkstregioninto an adjacent second 
region if the number of elements of the first region are: 

(a) considerably fewer (by a preselected amount) than the number of elements of the 
15 second region, and 

(b) less than athresholdnumberi? which represents aminimumnumber of elements in a 
region above which a merge is not allowed. 

An element is a preselected area of a region and is typically a single pixel. 

When the first region is merged into the second region the intensity level of each of the pixels is 
20 adjusted to that of the pixels of the second region. 

The resulting image is the mosaic image shown in Figure 3 . It is a simplified image made of a 
mosaic of homogeneous pieces of constant grey-levels andis a homotopy modification of the 
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original image. 

The boundaries of the grey s cale areas in the image are differentiated to provide boundary ridges 
to which a Watershed transform can be applied. 

If one uses a Watershed transform on the gradientimage the number of Watershed lines and the 
5 computational process in terms of time and memory requirements are optimised. 

The above process can be applied in different domains without previous knowledge of the regions 
ofinterestwithmthe original image. The preferred method is based onhomotopymodification of 
the original image prior to applying the Watershed transformation. The homotopy modification of 
the original image produces a mosaic image. 

10 Usingthe aboveprocess over-segmentation is considerably reduced and satisfactory results in 
terms of accuracy, computational time and memory are obtained. 

Figures 7 illustrates a flow chart showing the steps which are carried out in order to obtain the 
image of Figure 4. Figure 8 is a flow chart showing in more detail the steps for region growing of 
Figure 7 and Figure 9 shows inmore detail the steps for obtaining the gradient of the mosaic image 
1 5 of Figure 3 with Gaussian smoothing. It will be appreciated that other ways of obtaining the 
gradient used by the Watershed transform can be used, for example, morphological 
gr adi ent/op erators . 

Analysing Histograms 

The technique of analysing histograms aims to determine a seed pixel and a threshold. 

20 Figure 1 0 shows three different histograms 20, 22 and 24 similar to those of Figures 5A and 5B 
of apelvic CT image. Graph20is from the original CT image, graph 22 is graph20 with the couch 
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removed and graph. 24 is graph 20 without the couch and background. 

Referring to graph 20, this contains four distinct peaks 3 0, 32, 34 and 36. These have been found 
automatically using relational operators to define peaks infhe histogram and aminiimunheight to 
allow small peaks to be disregarded. The first peak 30 is by far the largest, typically being 
5 composed of about half of all the image pixels. It is located at the low intensity end of the histogram 
and analysis of the image shows that this represents mainly ah with some background counts. 

Hie second peak 32, veiy close to the first, is much smaller, with only about 1 .5% of pixels at the 
peak grey-level. This represents much of the image of the couch on which thepatient lies, although 
this will vary between couches. 

10 The final twopeaks 34, 36 are located further along the histogram and very close together. This 
indicates a degree of overlap in intensities between regions. These are separated by finding the 
local minimum between thepeaks using a similar method to that used to findpeaks automatically. 
The darker peak 34 represents fat and soft tissue. The brighter peak 36 represents muscle and 
organs. These pixels include the bladder and prostate. 

1 5 Note that the bones andrectumregion which include a wide range of grey-level are not represented 
by p eaks but by valleys or plateau. The interior of the rectum is located at the grey-levels b etween 
peaks 32 and 34 as depicted in the top left image in FigurelO. Finally the bones canbefoundat 
grey-levels above the fourth peak 36. 

It has b een observed that the removal of the couch from the CT by pre-processing or the removal 
20 of the background can affect the histogram, indeed the first two peaks 3 0, 32 may disappear as 
shown in graph 24. Note that the number of pixels in the region A between 0 and 1 20 is much 
reduced compared to graph 22. 



The threshold and seed points for various parts of the histograms are set out below. 
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rectum 

The threshold value T w - (L max _ A - L mlu _ A )l2 
The seed point = (L max . A + L min . A )l2 
bones 

5 The threshold value T w = (L max „ D - L min , D )/2 
The seed point - (L max , D + L miilm £)l2 

OAR type 1 

The threshold value T w = (L max _ B - L min _ B )/2 
The seed point = (L max . B + L^„^)/2 

10 OAR type 2 

The threshold value T w = {L max _ c - L mln _ c )/2 
The seed point = (L mnx _ c + L min ^l2 

To overcome this loss ofiriformationinthehistogram, the original code was modified such that the 
rectum can be identified from the sharp cut-off, below whichno pixels are found. This cut-off grey- 
15 level has been used to define the start of the lowest threshold region in a modified image. 

The result of applying the multi-region growing gives us a simplified image made of amosaic of 
homogeneous pieces of constant grey-levels (mean grey-level of the growth region) with the same 
properties as the mosaic image. This produces ahomotopy modification of the original image and 
consequently of the gradient image. Using the watershed transform in this simplified image the 



16 



WO 03/003303 



PCT7GB02/02945 



number of watershed lines and the computational process in terms of time and memory 
requirements are optimised. Compared to a standard, mnltithi-esholdingregiongrowingprocess 
withoutmosaic image, the method of the present invention produces a segmented image with less 
overgrowing of regions while reducing the number of regions which would be produced by 
5 watershed alone. 

It will be appreciated that the invention has application outside of the medical field, such as military 
applications, robotics or any application which involves pattern recognition schemes. 
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Claims 

1 A method of segmenting an image comprising: 

(a) selecting a first pixel unit from a first group of pixel units in which the pixel units all have 
substantially the same grey-level intensity; 

(b) selecting a first grey-level intensity range relative to the grey-level intensity of said first pixel 
unit; 

(c) comparing the grey-level intensity of said first pixel unit with the grey-level intensity of each 
of selected adjacent pixel units of said image; 

(d) assigning each said selected adjacentpixelunit as a pixel unit of the same region as said first 
pixel unit inresponse to the grey-level intensity of said adjacentpixelunit falling within said 
first grey-level intensity range; 

(e) comparing the grey-level intensity of said first pixel unit with the grey-level intensity of each 
of selected next adjacent pixel units of said image; 

(f) assigning each said selectednext adjacentpixel unit as apixelunit of the same region as 
said first pixel unit in resp onse to the grey-level intensity of said next adj acent pixel unit 
falling within said first grey-level intensity range; 

(g) repeating steps (e) and (f) for each of the pixel units in the image; 

(h) selecting a further pixel xuiit from a further groirp ofpixel units in which the pixel units have 
substantially the same grey-level intensity; 
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(i) selecting a further grey-level intensity range relative to the grey-level intensity of said further 
pixel unit; 

(j) comparing the grey-level intensity of said further pixel unit with the grey-level intensity of 
each of selected adj acent pixel units of said image, wherein each selected adjacentpixel 
unit which is already assigned as a pixel unit of a region is ignored; 



(k) assigning each unassigned said selected adjacent pixel unit as apixel unit of the same region 
as said further pixel unit in response to the grey-level intensity of said selected adj acent 
pixel unit falling within said further grey-level intensity range; 

(1) comparing the grey-level intensity of said further pixel unit with the grey-level intensity of 
each of selected next adjacent pixel units of said image; 

(m) assigning each said unassigned selectednext adj acent pixel unit as apixel unit of the same 
region as said fiutherpixelunitinrespon.se to the grey-level intensity of said selected next 
adjacent pixel unit falling within said further grey-level intensity range; 

(n) repeating steps (1) and (m) for each of the pixel units in the image; 

(o) and repeating steps (h) to (n) until all oftliepixelunitsin the image havebeen assigned to 
a region. 



2 A method as claimed in claim 1 wherein: 



said first group of pixel units is the largest group of pixel units in the image; 
and said further group of pixel units is the next largest group of pixel units. 
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3 A method as claimed in claim 1 or 2 further comprising the steps of: 

(p) building a mosaic image; 

(q) deriving the gradient of the mosaic image; and 

(r) applying a watershed transform to said gradient to provide said segmented image. 

4 Amethodasclaimedinclaim3 further comprisingfhe step of applying amerging operation 
to said segmented image to reduce segmentation of the image. 

5 A method as claimed in claim 4 wherein a region is merged into an adj acent region if the 
number of pixel units in said region is less than a preselected number. 

6 A method as claimed in any of claims 1 to 5 wherein eachsaidpixelunitisasinglepixel. 

7 A method as claimed in any of claims 1 to 6 wherein the step of selecting said first and 
further pixel units comprises creating a frequency histogram of the grey level values of said image 
and selecting a predetenuiiied grey level value in each distribution of said histogram to define said 
first and further pixel.units. 

8 A method as claimed in claim 7 wherein the predetermined grey level value for said first 
pixel unit is chosen from the largest distribution in the histogram, and for each successive further 
pixel unit is chosen from the next successive largest distribution in the histogram. 

9 Amethod as claimed hi claim 7 or 8 wherein said predetermined grey level is the average 
grey level of the distribution. 

10 A method as claimed in any of claims 1 to 9 wherein the distribution is a Gaussian 
dishibution and each adjacentpixelunit is assigned to aregion when the following conditionismet: 
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< T 

— J- TA 



JV 



where: 



L ave = the average grey level intensity of the distribution; 

L (xy) = the grey level intensity of the selected pixel unit in the distribution; and 

7V= a preselected threshold parameter value hi the distribution. 



11 A method as claimed in claim 1 0 wherein L ave is the peak value grey level and T w — (L max - 
L min )/2, where L max andX w//2 are preselected upper and lower grey level values for the distribution. 

12 A method as claimed hi any of claims 1 to 9 wherein the distribution is anon Gaussian 
distribution and each adjacent pixel unit is assigned to a region when the following conditions are 

10 met: 

L(xy) " Lave ^ ?wJ f or ^(xy) > Aive 
Lave - L(xy) ^ ^w2 f or L (xy) < L aVa 

where: 

Lavs — a preselected grey level intensity within the distribution; 
1 5 Lfcyj = the grey level intensity of the selected pixel unit; 

T wJ = a preselected lower threshold parameter value in the distribution; and 
T w2 = an upper preselected threshold parameter value hi the distribution. 

13 A method as claimed hi claim 1 2 wherein the value of L ave is obtained from a statistical 
analysis of at least a portion of the distribution. 



20 14 A method as claimed in claim 1 3 wherein value of L ave is equal to the mean of a selected 
sample region within the distribution. 

15 A method as claimed in claim 1 3 wherein said selected sample region comprises a 20 x 20 
pixel matrix. 
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16 A method of segmenting an image comprising: 

selecting apixelunit from a first group of pixel units in which the pixel units allhave substantially the 
same grey-level intensity; 

comparing the grey-level intensity of said first pixel unit with the grey-level intensity of each of a 
plurality of selected pixel units of said image; 

assigning each said selected pixel unit as apixel unit of the same region as said firstpixel unit in 
response to the grey-level intensity of said adj acentpixel unit falling within apreselected grey-level 
intensity range; 

selecting a further pixel unit from a further group of pixel units in which the pixel units have 
substantially the same grey-level intensity; 

comparing the grey-level intensity of said further pixel unit with the grey-level intensity of each of 
aplurality of selected pixel units of said image, wherein each selected adj acent pixel unit which is 
already assigned as a pixel unit of a region is ignored; 

assigning each unassigned said s elected pixel -unit as a pixel unit of the same region as said further 
pixel unitinresponse to the grey-level intensity of said selected adjacentpixelmiit falling withina 
preselected further grey-level intensity range; 

andrepeatingthe above steps until all offhe pixel units in the image have been assigned to aregtom 
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Calculate vectorial Gaussian mask with a standard deviation cr 



Calculate vectorial derivative of Gaussian mask with a standard deviation cr 
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Convolve the image with the derivative of a Gaussian for the rows 
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Calculate the smoothing of the ( 


jaussian( x ) in y direction : dgx | 



Convolve the image with the derivative of a Gaussian for the columns 



Calculate the smoothing of the Gaussian ( y ) in x direction : dgx 



Gradient of image = square root ( the sum of the square of the smoothed 
orthogonal directional derivatives of the image ) = ( dgx 2 = dgy 2 ) 0,5 
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